Active Learning for Sparse Least Squares Support Vector Machines
نویسندگان
چکیده
For least squares support vector machine (LSSVM) the lack of sparse, while the standard sparse algorithm exist a problem that it need to mark all of training data. We propose an active learning algorithm based on LSSVM to solve sparse problem. This method first construct a minimum classification LSSVM, and then calculate the uncertainty of the sample, select the closest category to mark the sample surface, and finally joined the training set of labeled samples and the establishment of a new classifier, repeat the process until the model accuracy to meet Requirements. 6 provided in the UCI data sets on the experimental results show that the proposed method can effectively improve the sparsity of LSSVM, and can reduce the cost labeled samples.
منابع مشابه
Least Squares Support Vector Machines and Primal Space Estimation
In this paper a methodology for estimation in kernel-induced feature spaces is presented, making a link between the primal-dual formulation of Least Squares Support Vector Machines (LS-SVM) and classical statistical inference techniques in order to perform linear regression in primal space. This is done by computing a finite dimensional approximation of the kernel-induced feature space mapping ...
متن کاملAn Iterative Learning Algorithm Based on Least Squares Support Vector Regression Machines
Aiming at the problem of the large training data set leading to amounts of calculation a sparse approximation algorithm of least squares support vector machine are proposed. Firstly using the thought of matrix block, convert the optimization problem of a Least Squares support vector machine into low order symmetric positive definite linear systems. Furthermore, use conjugate gradient algorithm ...
متن کاملHigh Dimensional Function Approximation [ Regression, Hypersurface Fitting ] by an Active Set Least Squares Learning Algorithm
1 1 Basics of Developing Regression Models from Data 3 1.1 Classic Regression Support Vector Machines Learning Setting 3 2 Active Set Method for Solving QP Based SVMs’ Learning 11 3 Active Set Least Squares (AS-LS) Regression 15 3.1 Implementation of the Active Set Least Squares Algorithm 19 3.1.1 Basics of Orthogonal Transformation 20 3.1.2 An Iterative Update of the QR Decomposition by Househ...
متن کاملL2 Support Vector Machines Revisited - Novel Direct Learning Algorithm and Some Geometric Insights
The paper presents a novel learning algorithm for the class of L2 Support Vector Machines classifiers dubbed Direct L2 SVM. The proposed algorithm avoids solving the quadratic programming problem and yet, it produces both the same exact results as the classic quadratic programming based solution in a significantly shorter CPU time. The connections between various L2 SVM algorithms will be highl...
متن کاملLoad Forecasting Using Fixed-Size Least Squares Support Vector Machines
Based on the Nyström approximation and the primal-dual formulation of Least Squares Support Vector Machines (LS-SVM), it becomes possible to apply a nonlinear model to a large scale regression problem. This is done by using a sparse approximation of the nonlinear mapping induced by the kernel matrix, with an active selection of support vectors based on quadratic Renyi entropy criteria. The meth...
متن کامل